🎧 AI Meets Foley: Crafting the Future of Film Sound
Level: Beginners
Location: St. Pölten UAS
🎧 AI Meets Foley: Crafting the Future of Film Sound
Where sound design meets machine learning – and your ideas take the lead.
This workshop sets the stage for an ambitious venture: developing a next-generation AI-based Foley tool. Over the course of one week, students with interest in Foley and audio production or in artificial intelligence – will explore the creative and technical possibilities of combining their Audio domain knowledge with cutting-edge AI technologies.
Contents:
Participants will be introduced to the current state of AI in audio production, including tools such as MultiFoley – a joint project by Adobe Research and the University of Michigan – as well as other AI-driven platforms like e.g. AIVA, Soundraw, and Amper Music. While these tools offer promising features for music and sound generation, none have yet fully addressed the unique challenges of automated Foley in film production. This gap opens up exciting potential for new approaches that integrate audio, video, and text input for intelligent sound design.
Throughout the week, students will analyze existing models, brainstorm use cases, and collaboratively sketch out first concepts for an AI system that can interpret visual motion, audio context, and written prompts to generate realistic Foley effects. By Friday, the group will present their concept(s) in a 10-minute pitch session.
The workshop is designed not only as a creative and educational format but also as a strategic step toward establishing such a tool. Potential partners include the Vienna Symphonic Library (VSL) and Synchro Stage Vienna, whose extensive sound archives and production infrastructure could play a key role in building a high-quality, adaptable Foley library.
The goal is for you to create and design a digital space and tell a small story within it.
Lecturers:
Wolfgang Schlögl
Workshop Lead | Composer, Sound Artist, Producer
Wolfgang Schlögl is a renowned composer, sound designer, and producer with deep roots in Austria’s electronic and experimental music scenes. As a founding member of iconic projects like Sofa Surfers and I-Wolf, his work spans film scores, live performance, and immersive sound installations.
With years of experience bridging the worlds of art and technology, Wolfgang brings a unique perspective to the future of sound design. He has scored numerous films and TV productions, collaborated with international artists, and constantly explores how emerging tools – from analog machines to AI – can expand creative possibilities.
In this workshop, he shares his passion for sonic storytelling and helps students translate their audio expertise into the next generation of sound tools.
Clara Hollomey
Workshop Lead | Curator, Researcher, Cultural Technologist
Clara Hollomey works at the intersection of science and audio technology. With a background in signal processing and computational intelligence, she develops novel approaches for the computational analysis, processing, and synthesis of sound. Her work as a sound engineer comprises the recording and mixing for clients from allover Europe.
With more than ten years of experience in the development and as the project lead of open source software for both, scientific and artistic purposes, Clara’s work focuses on enabling machine listening in a human-like fashion.
In this workshop, Clara brings a strong conceptual framework to enable students to implement their musical ideas in a state-of-the-art technical context.
Matthias Zeppelzauer
Workshop Lead | Researcher in Machine Learning & Media Technology
Matthias Zeppelzauer is a researcher and educator specializing in machine learning, audio-visual analysis, and human-centered AI. As a senior researcher and professor at the University of Applied Sciences St. Pölten, he works at the crossroads of technology and creativity – developing intelligent systems that can see, hear, and understand media content.
Matthias is passionate about making AI accessible to artists, designers, and creatives. His research spans from sound recognition and video understanding to interactive tools for creative production. He has led numerous applied research projects and loves collaborating across disciplines.
In this workshop, Matthias guides students through the potential (and limits) of AI, helping them bring their ideas to life – even without any prior coding experience.